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DETAILED ACTION 



Claim Rejections - 35 USC §112 



1 . The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

2. Claim 6 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

Claim 6 is recites the limitation "the bit shifter" in line 3. There is insufficient 
antecedent basis for this limitation in the claim. 



3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



4. Claims 1,6-9, 11-12 and 17-18 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Rainville et al. (Publication No. US2002/006941 1A1). 

In considering claim 1, Rainville et al disclose all the claimed subject matter, 
note, 1) the claimed a device for processing a PIP (picture in picture) in a TV 
comprising: a first video processing part for receiving, and processing a main picture 
video signal into a signal displayable on a screen is met by the parsing and layout 



Claim Rejections - 35 USC § 102 



Application/Control Number: 09/989,462 Page 3 

Art Unit: 2614 

engine 206 which conditions the HTML data for display on a television screen and 
extracts the specific video related information from the HTML source 202 (Fig. 6, page 
3, [0033]-[0036]), 2) the claimed a second video processing part for receiving, and 
processing a sub picture video signal into a signal displayable on a region of the screen 
is met by the video processor 210 for decoding the MPEG Audio/Video compressed 
stream 203 (Fig. 6, page 3, [0038]-[0039]), 3) the claimed a control part for providing a 
control signal according to a users command is met by the video and graphics (GFX) 
control engine 208 which takes the user inputs 201, which consist of Picture-ln- 
Graphics (PIG) controls 205 and transparency controls 204 (Fig. 6, page 3, [0037]), and 
4) the claimed an adjusting part for adjusting a presenting ratio of a video signal from 
the second video processing part in response to the control signal from the control part 
is met by the display formatter module 212 and the video resizing module 21 1 which 
allow flexible combinations of graphics data 215 and real time video stream data 216 to 
form a various Picture In Graphics (PIG) and transparency combinations at the output 
213, as illustrated in Figs. 3A-3C, 4A, 4B and 5A-5E (Fig. 6, page 3, [0038] and page 4, 
[0058]-[0064]). 

In considering claim 6, the claimed further comprising a switching part for 
superimposing the video signal from the first video processing part and the video signal 
from the bit shifter selectively according to the control signal from the control part is met 
by the display formatter module 212 and the video resizing module 21 1 which allow 
flexible combinations of graphics data 215 and real time video stream data 216 to form 
a various Picture In Graphics (PIG) and transparency combinations at the output 213, 
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as illustrated in Figs. 3A-3C, 4A, 4B and 5A-5E (Fig. 6, page 3, [0038] and page 4, 
[0058]-[0064]). 

In considering claim 7, Rainville et al disclose all the claimed subject matter, note 
1) the claimed a method for processing a PIP in a TV, comprising the steps of: (a) 
displaying the PIP when a user selects a PIP function is met by Figs. 2A-2C, the 
combined PIP/background image (page 2, [0026]-[0028]), 2) the claimed (b) displaying 
a mix ratio of the displayed PIP and main picture is met by Figs. 5A-5E which show 
different modes of operation based on viewer control over the size, position and degree 
of transparency (or level of translucency) of the Picture-ln-Graphics (PIG) television 
video image (page 2, [0029]-[0032]), and 3) the claimed (c) adjusting the mix ratio the 
user desires with reference to the displayed mix ratio is met by the display formatter 
module 212 and the video resizing module 21 1 which allow flexible combinations of 
graphics data 215 and real time video stream data 216 to form a various Picture In 
Graphics (PIG) and transparency combinations at the output 213, as illustrated in Figs. 
3A-3C, 4A, 4B and 5A-5E (Fig. 6, page 3, [0038] and page 4, [0058]-[0064]). 

In considering claim 8, the claimed wherein the step (b) includes the step of 
displaying the mix ratio in a form of an OSD is met by Figs. 5A-5E which show different 
modes of operation based on viewer control over the size, position and degree of 
transparency (or level of translucency) of the Picture-ln-Graphics (PIG) television video 
image (page 2, [0029]-[0032]). 

In considering claim 9, the claimed wherein the step (c) includes the step of 
adjusting a luminance of a PIP according to a users requirement with reference to the 
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mix ratio displayed in the OSD form, for adjusting the mix ratio of a picture in a region 
the main picture and the sub picture are superimposed is met by Figs. 5A-5E which 
show different modes of operation based on viewer control over the size, position and 
degree of transparency (or level of translucency) of the Picture-ln-Graphics (PIG) 
television video image because adjusting the weighted of each pixel in television video 
image means adjusting the luminance value of each pixel in television video image 
(page 2, [0029]-[0032]). 

In considering claim 1 1 , Rainville et al. disclose all the claimed subject matter, 
note 1) the claimed a method for processing a PIP (picture in picture) in a digital 
television receiver, the method comprising: processing a first video signal representative 
of a main picture into main picture data displayable on a display screen is met by the 
parsing and layout engine 206 which conditions the HTML data for display on a 
television screen and extracts the specific video related information from the HTML 
source 202 (Fig. 6, page 3, [0033]-[0036]), 2) the claimed processing a second video 
signal representative of a sub picture into sub picture data displayable on a portion of 
the display screen is met by the video processor 210 for decoding the MPEG 
AudioA/ideo compressed stream 203 (Fig. 6, page 3, [0038]-[0039]), 3) the claimed 
outputting a given number of data bits among the sub picture data according to a user 
command is met by the video and graphics (GFX) control engine 208 which takes the 
user inputs 201 , which consist of Picture-ln-Graphics (PIG) controls 205 and 
transparency controls 204 and the output from the video and graphics (GFX) control 
engine 208 should be the number of data bits because it operating in the digital domain 



Application/Control Number: 09/989,462 Page 6 

Art Unit: 2614 

(Fig. 6, page 3, [0037]), and 4) the claimed superimposing the outputted sub picture 
data bits on the main picture data is met by the display formatter module 212 and the 
video resizing module 21 1 which allow flexible combinations of graphics data 215 and 
real time video stream data 216 to form a various Picture In Graphics (PIG) and 
transparency combinations at the output 213, as illustrated in Figs. 3A-3C, 4A, 4B and 
5A-5E (Fig. 6, page 3, [0038] and page 4, [0058]-[0064]). 

In considering claim 12, the claimed further comprising displaying the 
superimposed picture data on the display screen, wherein both of the main and sub 
pictures are viewable in the portion of the display screen is met by Figs. 3A-3C, the 
viewer has control over the transparency of the television video image 503, transparent 
(or translucent) television video image 503 is in the foreground, overlaid on Web page 
500, by being transparent, television video image 503 does not obscure Web page 500 
(page 2, [0027]-[0028]). 

In considering claim 17, Rainville et al. disclose all the claimed subject matter, 
note 1) the claimed a method for processing a PIP (picture in picture) in a digital 
television receiver, the method comprising: a first video processing unit processing a 
first video signal representative of a main picture into displayable main picture data is 
met by the parsing and layout engine 206 which conditions the HTML data for display 
on a television screen and extracts the specific video related information from the HTML 
source 202 (Fig. 6, page 3, [0033]-[0036]), 2) the claimed second video processing unit 
processing a second video signal representative of a sub picture into displayable sub 
picture data is met by the video processor 210 for decoding the MPEG Audio/Video 
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compressed stream 203 (Fig. 6, page 3, [0038]-[0039]), 3) the claimed a controller 
generating a control signal according to a user command is met by the video and 
graphics (GFX) control engine 208 which takes the user inputs 201 , which consist of 
Picture-ln-Graphics (PIG) controls 205 and transparency controls 204 (Fig. 6, page 3, 
[0037]), 3) the claimed an output unit coupled to the controller for outputting a given 
number of data bits among the sub picture data in response to the control signal is met 
by the output from the video and graphics (GFX) control engine 208 should be the 
number of data bits because it operates in the digital domain (Fig. 6, page 3, [0037]), 
and 5) the claimed a switching unit coupled to the output unit for superimposing the 
outputted sub picture data bits on the main picture data is met by the display formatter 
module 212 and the video resizing module 21 1 which allow flexible combinations of 
graphics data 215 and real time video stream data 216 to form a various Picture In 
Graphics (PIG) and transparency combinations at the output 213, as illustrated in Figs. 
3A-3C, 4A, 4B and 5A-5E (Fig. 6, page 3, [0038] and page 4, [0058]-[0064]). 

In considering claim 18, the claimed further comprising a display screen coupled 
to the switching unit for displaying the superimposed picture data, wherein both of the 
main and sub pictures are viewable in the portion of the display screen is met by the 
television 102 of Figs. 3A-3C, the viewer has control over the transparency of the 
television video image 503, transparent (or translucent) television video image 503 is in 
the foreground, overlaid on Web page 500, by being transparent, television video image 
503 does not obscure Web page 500 (page 2, [0027]-[0028]). 
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Claim Rejections - 35 (JSC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 2-3, 13 and 19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rainville et al. (Publication No. US2002/006941 1 A1 ) in view of Yoo 
et al. (US Patent No. 6,333,762 B1). 

In considering claim 2, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 1 above, except for providing the claimed wherein the 
first video processing part includes: an analog/ digital converter for receiving, and 
converting analog R, G, B video signals into digital R, G, B video signals, and a format 
converter for maintaining outputs of the digital R, G, B video signals converted at the 
analog/digital converter constant. 

Yoo et al teach that referring to Fig. 10, an ADC & PLL (analog-to-digital 
converter and phase locked loop) 110 converts RGB signals input from a personal 
computer or a set-top box to digital data... and meanwhile, the scan format converter 
300 according to an embodiment of the present invention bi-sigmoid-interpolates 8-bit 
RGB signal levels input from the ADC & PLL 100 to convert them to the high or low 
resolution video format (col. 6, lines 1-48) and the output from the scan format converter 
300 is maintain at 8-bits (Fig. 10). 
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Therefore, it would have been obvious to one of ordinary skill in the art of the 
time of the invention to incorporate the A/D converter and the scan format converter as 
taught by Yoo et al into Rainville et al's system in order to provide the scan format 
converter which can display various video formats (e.g., SVGA, XGA and VGA) input 
from the external device such as a personal computer or a set-top box on a display unit 
of the projection television or a home television, without degradation of the image 
quality (col. 10, lines 17-22 of Yoo et al). 

In considering claim 3, Rainville et al disclose all the claimed subject matter, note 
1 ) the claimed wherein the second video processing part includes: a video decoder 21 
for receiving a video signal, and decoding the sub picture video signal from the video 
signal is met by the video processor 210 for decoding the MPEG Audio/Video 
compressed stream 203 (Fig. 6, page 3, [0038]-[0039]). However, Rainville et al 
explicitly do not disclose the claimed a second format converter for converting an output 
of the video signal decoded at the video decoder 22 constant. 

Yoo et al teach that referring to Fig. 10, the scan format converter 300 according 
to an embodiment of the present invention bi-sigmoid-interpolates 8-bit RGB signal 
levels input from the ADC & PLL 100 to convert them to the high or low resolution video 
format (col. 6, lines 1-48) and the output from the scan format converter 300 is maintain 
at 8-bits (Fig. 10). 

Therefore, it would have been obvious to one of ordinary skill in the art of the 
time of the invention to incorporate the scan format converter as taught by Yoo et al into 
Rainville et al's system in order to provide the scan format converter which can display 
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various video formats (e.g., SVGA, XGA and VGA) input from the external device such 
as a personal computer or a set-top box on a display unit of the projection television or 
a home television, without degradation of the image quality (col. 10, lines 17-22 of Yoo 
et al). 

In considering claim 13, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 1 1 above, except for providing the claimed wherein the 
first video processing representative of a main picture includes: receiving analog R, G, 
and B video signals representative of the main picture and converting analog R, G, B 
video signals into digital R, G, B video signals, and converting a format of the converted 
digital R, G, B video signals into a required format. 

Yoo et al teach that referring to Fig. 10, an ADC & PLL (analog-to-digital 
converter and phase locked loop) 110 converts RGB signals input from a personal 
computer or a set-top box to digital data... and meanwhile, the scan format converter 
300 according to an embodiment of the present invention bi-sigmoid-interpolates 8-bit 
RGB signal levels input from the ADC & PLL 100 to convert them to the high or low 
resolution video format (col. 6, lines 1-48). 

Therefore, it would have been obvious to one of ordinary skill in the art of the 
time of the invention to incorporate the A/D converter and the scan format converter as 
taught by Yoo et al into Rainville et al's system in order to provide the scan format 
converter which can display various video formats (e.g., SVGA, XGA and VGA) input 
from the external device such as a personal computer or a set-top box on a display unit 
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of the projection television or a home television, without degradation of the image 
quality (col. 10, lines 17-22 of Yoo et al). 

Claim 19 is rejected for the same reason as discussed in claim 13. 
7. Claims 14 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Rainville et al. (Publication No. US2002/006941 1 A1 ) in view of Lee (US Patent No. 
6,373,527 B1). 

In considering claim 14, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 1 1 above, except for providing the claimed wherein the 
second video processing representative of a sub picture includes: receiving a composite 
video signal and extracting a video signal representative of the sub picture from the 
composite signal, and converting a format of the extracted video signal into a require 
format. 

Lee teach that the AA/ switch 41 in the NTSC analog broadcasting signal 
processor 40 outputs one of the NTSC analog broadcasting signals received from the IF 
module 32 and the external input port 20 to a chroma processor 42, the chroma 
processor 42 generates a luminance signal Y, a first color difference signal R-Y and a 
second color difference signal B-Y being the second image signal from the NTSC 
analog broadcasting signal received from the AA/ switch 41 and then outputs the 
generated signals to a second A/D converter 43 and outputs the AID converted second 
image signal to a second format converter 62 in the format conversion portion 60, the 
format conversion portion 60 is a block for converting the frame formats of the first and 
second image signals respectively received from the HD digital broadcasting signal 
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processor 30 and the NTSC analog broadcasting signal processor 40, into a 
predetermined frame format (Fig. 1, col. 3, line 41 to col. 4, line 18). 

Therefore, it would have been obvious to one of ordinary skill in the art of the 
time of the invention to incorporate the video processor which includes the chroma 
processor and the format converter as taught by Lee into Rainville et al's system in 
order to provide an HDTV for synthesizing a plurality of image signals contained in the 
broadcasting signals of mutually different broadcasting systems into a single picture-in- 
picture (PIP) image signal and displaying the synthesized PIP image signal on the 
screen (col. 1, line 65 to col. 2, line 2 of Lee). 

Claim 20 is rejected for the same reason as discussed in claim 14. 
8. Claims 4, 10, 15 and 21 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Rainville et al. (Publication No. US2002/006941 1A1) in view of 
Tsujimoto et al. (US Patent No. 5,625,764). 

In considering claim 4, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 1 above, except for providing the claimed wherein the 
adjusting part is a bit shifter. Tsujimoto et al teach that the addition circuit 201 inputs 8- 
bit binary numbers which have been multiplied by their respective weights (i.e., Vz % V* 
1/8, 1/16 and 1/16) by means of digit shift, sums those products and outputs a sum, 
these weights total to 1 and form a geometrical progression of a common ratio of !4, the 
weight of output is total of weights (i.e., 1 ) and is shifted 4 digit places from the minimum 
weight of 1/16, therefore, the outputs is 12 bits, the selectors 202-206 select between 
an INPUT SIGNAL A and an INPUT SIGNAL B for their respective weight inputs, S2-S6 
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are selector control signals (Figs. 30 and 31, col. 25, line 9 to col. 27, line 21). 
Therefore, it would have been obvious to one of ordinary skill in the art of the time of the 
invention to incorporate the addition circuit with digit shift as taught by Tsujimoto et al 
into Rainville et al's system in order to correctly calculate the blending ratio to prevent 
the decrease of the brightness of the video signal to be displayed (col. 9, lines 24-28 of 
Tsujimoto et al). 

In considering claim 10, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 7 above, except for providing the claimed wherein the 
step (c) includes the step of fixing the mix ratio depending on connections between the 
video signal data from the first video processing part and the video signal from the 
second video processing part according to a users requirement. Tsujimoto et al teach 
that the addition circuit 201 inputs 8-bit binary numbers which have been multiplied by 
their respective weights (i.e., 1 /2, % 1/8, 1/16 and 1/16) by means of digit shift, sums 
those products and outputs a sum, these weights total to 1 and form a geometrical 
progression of a common ratio of 1 /2, the weight of output is total of weights (i.e., 1 ) and 
is shifted 4 digit places from the minimum weight of 1/16, therefore, the outputs is 12 
bits, the selectors 202-206 select between an INPUT SIGNAL A and an INPUT SIGNAL 
B for their respective weight inputs, S2-S6 are selector control signals (Figs. 30 and 31 , 
col. 25, line 9 to col. 27, line 21 ). Therefore, it would have been obvious to one of 
ordinary skill in the art of the time of the invention to incorporate the addition circuit with 
digit shift as taught by Tsujimoto et al into Rainville et al's system in order to correctly 
calculate the blending ratio to prevent the decrease of the brightness of the video signal 
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to be displayed (col. 9, lines 24-28 of Tsujimoto et al), since the selectors 202-206 
select between an INPUT SIGNAL A and an INPUT SIGNAL B for their respective 
weight inputs, the ratio of Tsujimoto et al is fixed depending on connections between the 
video signal data from the first video processing part and the video signal from the 
second video processing part according to a users requirement. 

In considering claim 15, Rainville et al disclose all the limitations of the instant 
invention as discussed in claim 1 1 above, except for providing the claimed wherein the 
given number of sub picture data bits are selected in descending order of significance of 
bits. Tsujimoto et al teach that the pixel blend unit 104 blends these RGB pixel data 
according to a blend ratio that is supplied to the unit 104 in synchronization with the 
RGB pixel data supply thereby outputting the result of the blending operation, in the 
present embodiment, the blend ratio is represented by a 5-bit fixed-point binary number 
and its MSB represents units (descending order)... and A is the value of any one of RGB 
components output from the first image memory 102 (main picture), and B is the value 
of the same color component as above output from the second image memory 103 
(sub-picture), since each of RGB components are formed by 8 bits, decimal place 
values are rounded-down (Fig. 14, col. 19, lines 1-39). Therefore, it would have been 
obvious to one of ordinary skill in the art of the time of the invention to incorporate the 
number of bits in binary number and its MSB represent unit (descending order) as 
taught by Tsujimoto et al into Rainville et al's system in order to correctly calculate the 
blending ratio to prevent the decrease of the brightness of the video signal to be 
displayed (col. 9, lines 24-28 of Tsujimoto et al). 
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Claim 21 is rejected for the same reason as discussed in claim 15. 

Allowable Subject Matter 

9. Claims 5, 16 and 22 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

Conclusion 

10. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Suen et al. (US Patent No. 6,552,750 B1) disclose apparatus for improving the 
presentation of graphics data on a television display. 

Westerink et al. (US Patent No. 6,359,657 B1) disclose simultaneously displaying 
a graphic image and video image. 

Ishikawa et al. (US Patent No. 5,969,767) disclose multipicture video signal 
display apparatus with modified picture indication. 

Kim (US Patent No. 6,473,130 B1) discloses method and apparatus for 
displaying sub-pictures. 

Shintani (US Patent No. 5,978,046) discloses television receiver with picture-in- 
picture function displays titles of reduced screen programs. 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Trang U. Tran whose telephone number is (703) 305- 
0090. The examiner can normally be reached on 8:00 AM - 5:30 PM, Monday to Friday. 



* 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Miller can be reached on (703) 305-4795. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



TT 
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